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ABSTRACT 

Presented is a progra.natic organization npdel y/hich 
is applied to research needs in special education. .Major advan'-qes 
of the model are given to be that of providing for several rest rcji 
activities which focus on one como}on problem, reducing the 
duplication of research effort, providing greater efficiei^cy in use 
of research personnel and resources, allowing fpr the use of common 
measurement units and data analysis to facilitate the conjparison pf 
data from all the research activities, and being able to conduct a 
number of projects concurrently. .It is thought that the utilization 
of the model would yield information on a common research prpblem in 
less time than it would- take to cpnduct a series of individual 
research projects. Application of the model would involve the setting 
of general and specific objectives, a project coordinator, several 
research teams each working on specific but related studies, field 
testing in schools and institutions, and dissemination pf findings to 
the public. . (Author/DB) * 
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ABSTRACT 

During the recent attempt to prepare an application for a 
programmatic research project, this conception for an organizational 
model was employed* It was believed that the major advantage of a 
programmatic research model would be that of: 1) providing for 
several research activities which focus on one common problem, 2) 
reducing the duplication of research effort and providing greater 
efficiency in use of research personnel and resources, 3) allowing 
for the use of common measurement units and data analysis which in 
turn facilitate the comparison of data from all the research activi- 
ties, and being able to conduct a number of projects concurrently. 
The utilization of this model would yield information on a common 
research problem in much less time than it v^rould take to conduct a 
series of individual research projects* 
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An Application of the Programmatic Organization Model to Applied Research 

Norri5 G. Haring 
David A« Krug 

introduction 

The administration of research funds through an organizational model known 
as "programmatic research*' has been in effect for several years In the field 
of education* Yet, the concept of programmatic research has been only loosely 
defined, and detai led* descriptions of models in operation cannot be found. 
Therefore, during the course of preparing a programmatic research grant 
proposal, we found it necessary to go through a step by step analysis of 
the programmatic research model, and its application to applied research. 

Because of the potential impact that programmatic research can have 
on the coordination of research, we felt that it v/ould be of value to share 
with our profession results of our efforts to develop a viable programmatic 
research model . 
Heed for Research 

Recently, in a conference dealing with Innovation in special education. 

Dr. Reynolds (1972) listed several factors that have created a great need for 

new models in special education. These factors include the knowledge that 

if all handicapped children were being served under the current models, we 

would need more than three times the 80,000 or more persons who are currently 

employed In the field of special education in this country. Researchers are 
therefore interested in finding ways of managing the instruction of these 
children that are more economical and Immediately available. 

Acknowledgements; This paper was supported in part by Grant No. 
OEG-0-70-39l6(607) from the U. S. Office of Education, Bureau of Education 
b for the Handicapped. 
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A second important factor Is the rapid change taking place in regiilc.r 
education v/hicH fs characterized by team teaching, middle schools, individu- 
ally prescribed instruction, and ungraded student placement. Traditionally 
trained teachers v;ill have to be provided with help in coping with these 
rapid changes* 

Another factor with far-reaching consequences is the growing belief that 
special education has been a ^*baby sitting*' service to remove deviant students 
from the regular classroom environment. Commissioner Edwin Martin, Jr., has also 
discussed thd need to provide handicapped students v/ith the skills they will 
need to secure employment as adults; less than forty percent of handicapped 
graduates are jpresently fully employed. To improve the relevance of pro- 
grams offered to these students would be to answer an obvious need and not 
merely to provide "baby-sitting.** 

These factors plus others identified by the Bureau of Education for the 
Handicapped point up both the need for systematic research in the area of 
classroom behavior management and curriculum development, and the critical 
need to develop procedures and curriculum materials for educating handicapped 
children. 

Based on past experience, it is our be Kief that the research questions 
raised by these needs can best be answered by using the applied research 
paradigm in a programmatic mode. 
Appl ied Research 

Applied research is concerned with the investigation of observable, 
measurable behaviors rather than with theoretical speculation concerning 
hypothetical inner states. Also, meaningful investigation often requires the 
Intense, continuous study of individual subjects or small groups, and not 
merely the averaging of effects pf infrequently measured variables over large 
groups of subjects. Early research In special education by Haring and Phillips 
(1962) utilized such an approach when looking at specific procedures for teaching 
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emot'lonally disturbed children. Later, Hcwctt (19C"0), utilizing the behaviorlstic 
point oiF view, investigated the learning problems of children in the engi- 
neered classroom. Following these early behavioristic research efforts, there " 
has been a virtual explosion of applied classroom research in special, education 
by numerous investigators of ivhom a partial list would include such names as: 
Beclcer (1971), Haring (1972), Hall (1970), Hewett (1968), Lindsley (1966), 
Levitt (1970)., O'Leary (1967), Patterson (1968), Homme (1969), Starl ing (1972) , 
V/alker (1972), and Uhite (1972). Results from these studies have provided 
useful information to the teacher on hoiv to improve pupil performance, refine 

instruction, and control classroom behavior. Hov/ever, even though past efforts 
/ ■ ■ ' ■ 

have provided better techniques for the education of handicapped children 

today, a great need remains to continue our efforts to improve the quality of 

educational management that will be available tomorrow. 

Prog rammatic (Research 

A;1 programmatic research applies the talents of many investigators to 
a conmon area of research. However, an essential characteristic of programmatic 
research is the organizational approach taken to investigate a variety of 
research questions. Specific objectives are established and then a critical msss 
of talent is brought together to share expertise in solving the particular 
problems encountered in progressing towards those objectives. The common 
background and techniques of the researchers are optimally employed In 
programmatic research; this experimental framework assures a convergence 
of their final procedures and products. 

The major advantages of programmatic research are: first. It allows for 
a number of activities investigating a common problem. Ideally, educational 



sources of information ore generated out of the combined results of related 
research projects- The initiation of several experiments within a programmatic 
organizational model, each attempting a slightly different dimension 
of a special problem, often provides a great deal more information than 
each researcher could provide if v;orking alone. From that standpoint 
there is also a certain amount of economy in expenditure of funds; more 
outcomes and products are avai lable. than would be realized from individual 
research projects funded separately. Second, programmatic research usually 
is funded for longer periods than are single projects; so long as anticipated 
products are forthcoming^ programmatic funding can'be extended. This promotes 
research efficiency and enables teams to plan^ to better attract personnel, 
and to achieve long-term gains from their accumulated expertise as they investigate 
cornmon problems over an extended period of time. 

Finally, tne rationale for using programmatic research as an organizational 
model can De justified to the extent that such a model prevents duplication, 
applies concerted effort to a problem, and efficiently utilizes research 
personnel and resources* 
Applied Research Philosophy 

The research philosophy that anyone concerned with education should adopt 
IS guided by the ultimate aim of education: to change students* behavior 
so that a student lacking some skill or knowledge gains it. Researchers differ 
primarily about ;mat they believe will change behavior. Often educators have 
advocated one or another method of changing behavior without systematic 
Investigation of whether or not these methods would be successful with the 
pupils in their charge. Applied behavior analysis attends to the need for 
scientific method in educational research; this advantage H discussed below 
as the third characteristic of applied behavior analysis. 



The principles of applied behavior analysis can serve as the foundation for 
the procedures- used in an intensive investigation of behavior. These principles 
are based* on two assumptions. The first assumption is that the primary data 
are the observable interactions between a biological organism and environ- 
mental events; and it is these interrelationships which constitute the material 
to be recorded (Bijou, Peterson, & Ault, I968) . The second assumption Is 
that concepts and laws are to be derived from research which is based on 
precise measurement using experimental controls and numerous replications. For 
data to be of experimental value they must consist of units vrfiich describe 
interactions between behavioral and environmental events empirically. As an 
example, a student reads because of elements present In his environment; 
a teacher who wants to improve his reading will need measures of his initial 
reading behavior and data about environmental conditions that might be Influencing 
It, and later will need data about the effects of changes the teacher has . 
made in the student's environment to Improve his reading performance.* Ue 
have found, however, that a measure of frequency is preferable to that of 
duration, intensity, and latency because » first, frequency shows changes over 
both short and long periods of time; second. It specifies the amount of behavior 
displayed; and, finally. It is applicable to a very wide range of behaviors* 

The general procedure used in an applied analysis of behavior is to 
arrange experimentally an environment in which independent variables are 
systematically manipulated to change behavior* Frequently, the dependent 
variable Is observed and recorded In terms of rate of responding, which has 
proven to be a sensitive barometer of performance and is applicable to a 
wide range of human responses* Three additional characteristics of the 
methodology used are 1) the precise specification and objective measurement 
of behavior; 2) a focus on environmental determinants; and 3) the use of 
empirical evaluations based on continuous measurement. 

it 

There are several measures i^hlch a teacher may use to d&tcrninc chongcs 
la roading performance during the teadi I ng/1 earning process* 



Bphavfor analysis is primarily concerned with the observable thi.igs that 
children and teachers do. The concern Is with observable behavior because 
technology has not yet provided a way to work, with niental processes or Internal 
events. However, because behavior is publicly observable, it is possible to 
define behavior units which can be empi rical ly measured, experimentally 
manipulated, and repeated. The importance of this emphasis on units of behavior 
is that it provides sufficient specificity about what is being measured to 
insure that the effects of an independent variable can later be evaluated, and, 
if need be, replicated. In this way, we can find out if an intep/entlon variable 
was successful ; that is, if It changed the behavior predictably (Baer, Wolf, 
6 RIsley, I968). 

The second characteristic of applied behavior analysis is its focus on 
environmental determinants. The emphasis is on the environment because it is 
the environment which a teacher can control and manipulate In trying to 
develop desired changes in pupil behaviors. A teacher cannot change the 
genetic structure of his pupils or manipulate physiological and pharmacological 
variables in an effort to help his pupils learn. But he can change school 
environments to help children perform productively. 

The third characteristic of appped behavior analysis is the use of 
empirical evaluations based on continuous measurement. In the past, educational 
innovations and practices have often been implemented without the benefit of 
objective examination of their effectiveness. If this mode of operation is 
continued it is doubtful if education wi 1 1 improve qual i tat iveiy. Experimentation 
Jiowever, provides for an evaluation of innovations to take place, which will 
result in the discarding of those procedures which are ineffective or harmful 
•and the validation and application of those procedures and products which are 
critical to the advancement of a technology of education. 
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These three research characteristics combine what are probably the most 
Influential results of recent advancement in research technology and .form a 
philosophical basis which can guide each research project in a comprehensive 
program project. 
Research Strategy 

All research involving a comparison of treatment effects involves experi- 
mental control (Sidman, I960). In behavior analysis, control of variables 
is demonstrated through the use of one of two basic research strategies. These 
are the reversal design and the multiple baseline. The reversal or ABA design 
measures a behavior until it is relatively stable. Once stability has been 
achieved (baseline), an experimental variable (B) is imposed to see what effect 
It will have on, the measured (dependent) variable. If there is an observable 
effect over a period of time, then condition A (baseline) is reinstated. The 
rationale for this procedure is that condition A provides a basis for pre- 
dicting what the behavior would have been at a future time if the experimental 
condition had not been imposed. A return to baseline is accomplished for th' 
purpose of testing the accuracy of the original prediction. If the level of 
behavior returns to baseline when the intervention (or treatment) Is removed, 
then the original prediction has been confirmed (Hanley, 1970). 

in applied settings, a major problem with the ABA design is the failure of 
a behavior to return to baseline due to learning. For instance, a non-reader 
who learns to read at 100 words per minute will not revert to illiteracy 
When the experimental phase ends. One can never get a valid indication of 
theeffect of the experimental intervention In such an instance by using an ABA 
design. However, an effective alternative to the reversal design is the multiple 
baseline which involves the measurement of s-everal variables over a period 
Of time. At this time it is known that there are .at least three different 



multlpU baseline designs possible for investigating behavior.- There are 
designs to be applied a) across situations, b) across individuals, and c) 
across behaviors (Hall. Cristler. Cranston, S Tucker, 1970). Measurement 
across situations means that the same behavior of a single individual is 
measured concurrently in different stimulus situations. Measurement across . 
Individuals involves the concurrent measurement of the same behavior of several 
Individuals in the same situation. Measurement across behaviors means that 
two or more behaviors of the same individual are measured concurrently while 
experimental procedures are applied to one behavior at a time. 

Many variations of these designs are possible through combinations of 
elements of the two basic designs (reversal and multiple baseline), and many 
more will be developed as technology advances. The advantages of using these 
designs at this time are that they lend themselves to experimental manipulation 
which provides the process for finding answers to the question: "What 
controls behavior?" In addition, these designs enable researchers to gather 
data in ways which exemplify repl ication-which is the essence of reliability 
and generality. This design has great practical value when one is investigating 
experimental conditions affecting handicapped children. Each child serves as 
his 6Wn control, thus avoiding that almost impossible task of matching 
handicapped children or drawing a treatment population from a larger pool 
of handicapped children and attempting to provide control. 

Common procedures which all Program Project experimenters utilizing appl ieJ 
research should probably implement in their research designs are depicted on the 
Research Procedures Flow Chart (Figure 1). Three of these procedures, however. 



Insert Figure 1 about here 



which must be utilized In every study are l) direct observation, 2) continuous 
measurement of dependent variables, and 3) systematic manipulation of independent 
variables. . 
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Direct observation of the dependent variable requires that it first 
be identified in terms of observable movements the child makes which can be 
counted. Direct measurement by teacher and/or pupil recorders Is the most 
common procedure used for direct observation. 

Continuous measurement requires that each pupil's responses be monitored 
throughout the day. Only by such continuous recording can a valid, reliable 
Index be provided of the effect of the conditions being investigated. 

Finally, systematic manipulation of independent variables 1 eads di recti y 
to 1) an analysis of the cause of change; 2) the technology for replicating 
that change; 3) an evaluation of the effectiveness of the change; and h) an 
evaluation of the general ization of that change. 

Programmatic Research Organization 

The Program Project being conducted at the Experimental Education Unit is 
organized Into three major research programs which include a number of research- 
projects directly related to two basic problems being investigated. These two 
problems are set forth as priority concerns by the Bureau of Education for the 
Handicapped, and our research efforts are In part an attempt to attend to these 
priorities. This research program Is a comprehensive one designed to investigate 
a wide variety of events and conditions which come to bear on the Instruction and 
management of handicapped children In a variety of settings. The Program Project 
Identifies the many variables that are Involved In teaching the handicapped. The 
general areas of Investigation that have been delineated are 0 the curriculum, 
I.e., reading, spelling, penmanship, creatn/e writing, and mathematical compu- 
tation; 2) assessment and classroom performance measurement; 3) instructional 
procedures Including the Identification and arrangement of instructional cues, 
displaying format, length and duration of assignments, and classroom organization 
k) management of social behavior; and 5) the Investigating, developing, and 
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refining of a variety of Instructional programs. The accompanying flow chart 
(Figure 2) specifies the goals, specific objectives, research strategies, outcome 
and products and provides a picture of the research process. 



Insert Figure 2 about here 



Inte rrelated Activities of Research Teams 

While each team has a specific major emphasis In programmatic Investigation, 
all of the teails' research projects and the products that emanate from their 
activities are jC lose ly related, as can be seen' from the above. Flow Chart. The 
two major objectives of our proposal govern the many separate activities of 
the teams to promote the common specified objectives. The results of the teams' 
activities converge at many points, and reviews of these activities are 
scheduled quarterly throughout the project. These quarterly summary periods 
also serve as times for evaluating team progress and for making decisions about 
refinements or changes In activities as the teams progress. They are also 
an opportunity for these teams to share with each other Information about the- 
areas where outstanding progress Is being made. 

Four program coordinators are responsible for the research activities 
of each of the project Investigators. Semimonthly me6tlngs, chaired by the 
project director, are held to share Information about progress and findings, 
and to Integrate this Information for possible alteration of the research 
activities of some of the research projects. 

Our research will be programmed to flow In this general direction: 
sequence, continuity, and materials and outcomes. That Is: For example, 
Team I will research the question of what characteristics Instructional material 
must have to be effective; team II will design procedures for Integrating 



I Figure 2 
Proj;act Flow Chart 



URCAU OF EDUCATION FOR 
HANDICAPPED I T I E S 



t THE I 



IEEU Programmaticj 
Research Goals I 



To educat* avery child In every 
state including severely 
hendlcepp«d children. 




To devc 1 0^ per f ormance criteria. Instructional 
materials, and procedures for teaching chi idron 
who are severely hantticapped by such disorders 
as severe emotional dr«turbances, mental 
retardation, motor and Sensory deficits, and 
multiple handicaps. 



2. 




To provide more effective i nte- 
gretion of moderately handicapped 
children Into reguld school programs. 



To develop systematic curricula, performance 
criteria. Instructional materials and procedures 
which will enable regular classroon tenchers to 
successfully Integrate moderately hendlcapped 
children, such as the educable mentdlly retarded, 
learning dlsah*ed, and behaviorally clsturbed 
Into the regular classroom milieu. 




3- 



4« 




3. 



06JECTlVi$ 



To Investigate the I nstruct i one ! vdriables 
which are critical to increase the per^f orf^ance 
of severely hardicepped children ir special, 
S'«' f *-contd!ned classrooms, and in residential 
feci M t ies. 

To develop and evaluate pertorn-arce criteria 
on besic learning and life skills for the . 
severely retarded. 

To develop and evaUate i nstruct io'*l ranage- 
nent procedures that lead to pcrfornarce 
criteria on learning and life skills for 
t^e severely handicapped. 

To develop and evaluate programs ot instruc- 
tion from the results of tosic research on 
the critical instructional variebies. 



To investigate the instructional vdriables 
which are critical to increasing performance 
of Moderately handicapped children In a variety 
of educational settings (special, scl f«contd i ne 
resource, and regular classrocms) and thereby i 
fecltltate successful integration intc regular 
school programs to the fullest extent possible 

To develop assessment and measurement procedure 
beted on our investigations, to facilitate 
intcgrat ion of iroderately hand icappedj:chi Idren 
Into regular school programs. 

To develop educational procedures and-products 
on the basis of the results of these Investiga 



RCSEAKCH PROjeCTO 
(STPATEGIES) 



POTtMlAl EOuCATICN^t 
OUTCOMES ANO PRODUCTS 




^tructiona! vorisblos 
increaie the pericrrance 
d chiidren^ir special* 
Oms, and Ir, reS'Cential 



e pertorrarce criteria 
life sk i i I s for the 



e i nstruct ion4i ranage- 
ead to per f ornarcc 
ir.d life ski I I s icr 

led . 

c programs of mstruc- 
of tasic research on 
onal variables. 





tructional variables 
increasinQ performance 
ped children If* n variety 
is (special, seM*contal ned, 
classrooms) and thereby to 
integration intc regular 
fullest extent possible. 

and measurement procedures 
itions, to faciiitate 
•ty handicapped children 
^^0 grams. 

procedures ano products 
rsalts of thesv.irvcstigat Ions. 



Project on instrLCtlonal variables including 
drill and practice, anfeccdont, concurrent, 
and subsequent events, and contingencies or 
reinforcement relevant to increasing perform 
ance of severely hendicappoo children. 

Project on the investigation of perfornance 
criteria for determining competencies on 
the basic learning and life skills. 



Project on the investigation of the procedures 
of instruction leading to performance criteria 
in tho basic learning and life skills for the 
severely retarded. 

Project on the development and evaluation of 
instructional programs for the severely 
handicapped. 
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1. Project on the development of Instructional 
programs for moderately handicapped children. 

2. Project on Integration of handicapped children. 

3. Projection assessment of handicapped children. 

4. Project on academic proficiency criteria. 

5. Project on Instructional procedures. 

a. Drill procedures for the acquisition of 
proficiency on basic academic skills., 

b. Effects of antecedent and concurrent 
events upon pupil performance. 

c. Effects of concurrently presented answers 
on the acquisltlcr of acadeiric skill. 

6. Project on social behavior. 

a. Identification and assessment of socially 
adaptive and Inappropriate classroon behavior*. 

b. Investigation of managerial procedures^' 
dealing with social classroom behavior. 

7. Project on daily performance measurement, 
charting and analyses. 

Measurement intervals, 
b. Measuref»enf frequencies. 

• • Project or the d«velcpnrcnt and evaluation of 
lri>truct{&nal curricula ir: 
4. Phonics d. renman^hip 

b. re*idiM9 c. ^'.-th 

^ • ipi Hire 



Procedural Out cones 

1. A specification of performance criteria 

for conpetency in the basic skills Involved 
In time telling, change making, newspaper 
rea^J i »g , f ol I owi ng -bJ * i n -struct ions , 
alphabetizing, and measuring 

2. Specific procedures of instruction leading 
1o performance criteria In certain basic 

I ife ski Us. 

3. Specific procedures for arranging antecedent 

and concurrent events for increasing performance. 

4. Procedures for drill and practice. 

5. Procedures for nanagement of classroom behavior . 
Instruct I ona I Products 

instruct I ona I Programs f or : 

a. Time telling f. Alphabetizing 

b. Change making g. Borrowing 

c. Newspaper reading h. Measuring 

d. Following verbal Instructions 

e. Discrimination programs for colors, 
shapes, numbers, and letters. 



Procedural Outcomes 

1. Specific Procedures for teaching: 

a. Reading c. Penmanship 

b. Spelling d. Math 

2. Proficiency criteria for math, reading, 
writing, and spel I ing. 

3. Procedures for time referencing in 
measurement of classroom behavior. 

4. Procedures for administrative monitoring 
of classroom instruction. 

Instructional Products 

1 . Instructional booklet for teach! n^: 

a. Spelling c. Readlr^y 

b. Penm'anship ^. Math 

2. Classroom Assessment Battery Including: 

a. Probe Sheet 

b. Examiner's Sheet 

c. Demonstration Item 

d. Instructions for each probe. 

3. Drill exercises on basic academic skills. 

4. Definitions and performance criteria 
for Successful social behavior. 

5. Instructional progrars for: 

a. Clscrimlnetlon of letters and sounds. 

b. Phonics an^ reading 

c. Creative writing. 
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children Into new programs and will provide useful Information about sequencing 
materials; Team III will produce Instructional programs for the two 
critical populations mentioned In our objectives, benefiting from the basic 
knowledge Team I will provide and from the practical procedures for Integrating 
pupils Into new programs that Team II will develop. 
Administrative Processes 

• Information collected on each project Is provided to project Investi- 
gators and to the program administrator. The investigators use the data as 
feedback' Information for changing- procedures to Improve their outcomes. The 
program administrator uses the information to see that resources are being 
used efflclenntly and to determine what endeavors need and merit more 
assistance (See Figure 3). The procedures used In collecting data for 
administrators should be uniform from project to project and one effecfve 
technique for assuring this Is the Programmed Evaluation and Review Technique 
(PERT) system (Tracy, Brunstrom, & Dudley, I368) . 



Insert Figure 3 about here 



Formative data for Internal administrative purposes will also use 
program review and evaluation techniques. The PERT diagrams will be developed 
at two levels, the first providing a global view showing only primary objectives, 
«nd the other showing a detailed view of the ongoing working relationship 
quarter by quarter. This Is generally necessary as a practical matter because 
of the complexity of programmatic research. This also allows for corrective 
feedback In the PERT Itself, and, as a result, becomes self-adjusting for more 
accurate planning. 

The PERT allows resource forecasting and accounting of manpower, space, 
O pupil populations, materials, and support services. This type of Information l« 
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also useful In summatlve reports. Formative reports will be greatly simplified 
because all that will have to be specified In them Is the project's proximity 
to Its objectives. If this Is not adequate, more attention can be given on 
the basis of exception reporting. Further, In the process of developing 
PERT diagrams, an additive effect on the total results of the project Is 
experienced owing to Improved communication among staff members. 

Summary 

It has been documented by several writers (Smith, 1971; Martin, 1972) 
that there are many critical behavioral research needs In special education. 
Two of these needs, which fit within the realm of applied research, operate 
In the natural environment, and which permit a precise description of 
the Interactions between behavioral and environmental events are: 1) the 
development of new Instructional technology based on empirical documentation, 
and 2) the development of clinical teaching procedures which specify the 
Important educational variables and provide the diagnostic and Individualized 
prescriptive teaching to meet these needs. 

Past experience has shown the functional analysis of behavior model to 
be an effective research methodology In the area of applied research. However, 
this same experience has shown that research In special education has been 
characterized by lack of reliability, control, and generality (Hanley, 1970). 
It appears that one effective organizational procedure which can be used to 
overcome the deficits of earlier research Is the programmatic research 
model. By Its very structure, programmatic research requires Investigators 
• to make administrative decisions which will result In a more systematic 
examination of the critical variables of Instruction. 
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